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ABSTRACT 

The effects of behavioral objectives and/or rules on 
the learning frccess were examined using a hierarchical imaginary 
science called the Science of Xenograde Systems, The learning task 
was presented by a computer assisted instruction system to 130 
introductory educational psychology and science education students. 
After being given a battery of six cognitive ability tests, all 
student? were randomly assigned to either an example only, an 
objective-example, a rule-example or an ob jec ti ve-rule-exaraple 
treatment. The presentation of rules significantly reduced the number 
of examples and total time required to complete the task and 
increased performance on a transfer test. The presentation of 
objectives did not significantly affect total or display latency, but 
significantly reduced the requirement for reasoning ability. It was 
concluded that objectives have orienting and organizing effects which 
dispose students to attend to, process, and structure relevant 
information in accordance with the given objectives, (Author/FL) 
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THE EFFECTS OF THE AVAILABII.IT V OF OBJECTIVES 
AND/OR RULES ON THE LEARNING PROCESS 



ABSTRACT 

Paul F. Kerri 11 
The Florida State University 



U S OEPARTMEUT OF KE UTM, EDUCATION 
A WELFARE 

OFFICE OF EDUCATION 
TH;.' DOCUMENT MAS 'JtEN REPRODUCED 
EXAl*I Y AS RECEIVED FROM THE PERSON OR 
ORGANIZATION ORIGINATING IT POINTS OF 
VIEW OR OPINIONS SUTEr 00 NOT NECES 
SAR LY REPRESENT OFFICIAL OFFICE CFEOU 
CATION POSITION OR POLICY 
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The effects ot behavioral objectives ar.d/or rules on the learn- 
ing process were investigated using a hierarchical imaginary science 
called the Science of Xenograd* Systems. The learning task was pre- 
sented by an IBM 1500/1800 computer -assi sted instruction system to 130 
introductory educational psychology and science education students. 

After all Ss were given a battery of six cognitive ability tests, they 
were randomly assigned to either an example only, an objective-example, 
a rule-example or cn objective-rule-example treatment. The Ss were 
required to meet a minimum criterion performance at each level of the 
task before proceeding to the next level. The presentation of rules 
significantly reduced the number of examples and total time required to 
complete the task and Increased performance on a transfer test. The 
presentation of objectives did not significantly affect total or display 
latency, but significantly reduced test-1 tern- response latency and the 
required number of examples. The presentation of objectives and/or rules 
also significantly reduced the requirement for reasoning ability. On 
the basis of the results of this study It was concluded that objectives 
have orienting and organizing effects which dispose students to attend 
to, process, and structure relevant information In accordance with the 
given objectives. 
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THE EFFECTS OF THE AVAILAB1LITT OF OBJECTIVES 

i 2 

AND/OR RULES ON THE LEARNING PROCESS 

It seems that even though educational psychologists (Bobbitt, 

1924; Tyler, 1951; Bloom, 1956) had been stressing the need for precise 
statements of instructional objectives for many years, it was not until 
Hager (1961) published his book on preparing objectives that the. edu- 
cational community started to take instructional objectives seriously. 

Si nee Hager's hook, many people have mounted the bandwagon and filled 
the literature with articles extolling the virtues of instructional 
objectives. However, there are those (Eisner, 1967a; Ebel , 1967; 

Kliebard, 1968; Jackson and Belford, 1965) who question the value of 
objectives and feel they might actually be a hindrance to the design of 
instruction. After an interchange of views in the literature, Eisner 
(1967b) responded to his critics by pointing out that the contribution 
of educudonal objectives to curriculum construction, teaching, and 
learning is an empirical problem, while most articles that have been 
written a^e merely logical arguments. He further claims that the little 
research that has been done Is at best Inconclusive. 

The purpose of this study was to investigate what effects the 
presentation ot' behavioral objectives would have on the learning process. 
Specifically, this study /as conducted to further clarify: 1) how the 
presentation of objectives would affect Ss performance on criteria measures, 
2) how other task characteristics would vary the effects of presenting 
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objectives, and 3) how individual aptitudes interact with the presenta- 
tion or non-presentation of objectives. 

It was hypothesized that objectives would serve as orienting 
stimuli which dispose the student to attend to, process, and organize 
relevant aspects of displayed information in accordance with the stated 
objectives. Therefore, the presentation of objectives was expected to 
reduce the number of examples and amount of time required to learn the 
task, facilitate performance on transfer retrieval criterion measures, 
ana reduce the requirements for memory and reasoning abilities. However, 
it was expected that these effects would be tempered by, or interact 
with other properties of the learning task. If objectives are inserted 
in a task which has minimal orienting or organizing stimuli, then the 
above hypothesized effects should be very evident. On the other hand, 
if objectives are Inserted in a task which has other effective orienting 
stimuli such as rules, then the objectives would be somewhat redundant 
and have a more subtle effect. 



Method 

Subjects , The 160 Ss who participated In this study were taker, 
from four sections of ar, Introductory educational psychology course and 
three sections of a science education course at the University of Texas 
at Austin. All Ss were required to participate as a class assignment. 
However, 30 of the original Ss were eliminated because they failed to 
complete all three phases of the study. 
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Ability Measures . A battery of six cognitive ability tests was 
administered to all Ss. The battery consisted of three tests selected 
from the Kit of Reference Tests for Cognitive Factors (French, Ekstrom, 

& Price, 1963) and three task-relevant tests developed for this study. 

The task-relevant tests required the Ss to process the same type of 
information that must be processed in the learning task, while the pub- 
lished tests required similar processes on information not related to the 
task. A list of the individual tests and their factor designations 
appears In Table 4. 

Experimental Tasks and Materia ls. The learning task used In this 
study consisted of a. hierarchical imaginary science called the Science of 
Xenograde Systems. The structure and content of the task were similar to 
those of formal science topics, but the Imaginary nature of the science 
assured that none of the Ss had any previous experience with the task. 

In the version of the science used for this study, a Xenograde system 
consists of a nucleus with an orbiting satellite. The satellite is com- 
posed of small particles called alphons which also may reside in the 
nucleus. The subject matter of the science deals with the principles 
or rules by which the activity of satellites and alphons may be predicted. 
The terminal objective of the task requires that Ss predict and record 
the state of the alphons and satellite of a Xenograde system at successive 
time Intervals given the initial state of the system at time zero. 

The instructional program consisted of 10 modules. The materials 
for each module Included a statement of a subobjective, a statement of a 
rule, five examples of the rule, and five short constructed response tests. 
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The examples were in the form of parti alXenograde tables which showed 
the activity and relationships of a Xenograde system at several points 
in time. Samples of these materials may be found in Figure 1. 



Insert Figure 1 about here 



The instructional program was written in the Coufaewriter II 
language and presented to the Ss by the IBM 1500/1800 computer-assisted 
instruction system. 

Procedure . After the administration of the cognitive ability 
test battery, the Ss were randomly assigned to cr.e of four groups: an 

example only group (n=32), an objective-example group (n=33), a rule- 
example group (n s 32), or an objective-rule-example group (n=33). Figure 
2 is a graphical representation of the 2x2 factorial design formed by 
these groups. 



Insert Figure 2 about here 



In learning t'"i science, Ss in the example only group received an 
example of the first rule of the science displayed on a cathode ray tube. 
After studying the example, each S responded to a uhree-item constructed 
response test where he was required to predict certain values using the 
rule Inferred from the example. If the $ responded correctly to two out 
of the three test items, he was given an example of the next rule in the 
sequence. Otherwise, he was given another example of the same rule fol- 
lowed by another three-item test. This sequence of new examples followed 
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by a test continued until the £ responded correctly to two of the three 
test items or received five examples. The task was completed after all 
10 rules of the science were learned to the required criterion. A post- 
test was administered immediately following completion of'tbe learning 
task, and retention *and transfer tests viere administered two weeks later. 

The Ss in the other three groups learned the science by the 
same basic procedure except for the following treatment differences. The 
objective-example group was shown a statement of a subobjective on an 
image projector while the corresponding example was displayed on a cathode 
ray tube. The rule-example group was displayed a statement of the rule 
corresponding to each example, and the objective-rule-example group 
received both the objective and the rule in addition to the example. 

Results 

In addition to total scores on the six cognitive ability tests, 
posttest, retention test, and transfer test mentioned in the previous 
section, data were obtained for each $ on the following criteria: total 
number of examples required to learn the science, display latency, test- 
item-response latency, and total latency. Display latency was the total 
time S. spent studying the examples and, depending upon S/s treatment 
group, the corresponding rules and/or objectives. Test-item-response 
latency was the total time required by $ to respond to the three-item tests 
following each example display. Total latency was merely the sum of the 
display and test-item-response latencies. 

The descriptive statistics and reliabilities of the ability, post, 
retention, and transfer tests are reported elsewhere (llerrlll, 1970). 
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The treatment effects on the number of examples required to 
learn the task is graphically portrayed by the group frequency distri- 
butions given in Figure 3, while the corresponding means and standard 
deviations are presented in Table 1. The results from a two-factor 
analysis of variance revealed a significant rule effect, £(1,126) = 

48.7, £ < .001, wherein the presentation of rules reduced the number of 
examples required to learn the task. A significant objective effect, 
£(1,126) = 4.7, j> < .05, shows that the presentation of objectives also 
/educed the number of examples required, but this reduction was not 
nearly as marked as the reduction caused by the presentation of the rules. 



Insert Figure 3 about here 



Insert Table 1 about here 



The means and standard deviations for each group on the three 
latency measures may be found In Table 2. The latency measures were also 
analyzed using a two-factor analysis of variance. A significant rule 
effect was obtained on all three measures (F( I ,123) a 21.9, £ < .001 for 
display latency; £(1,126) = 48.8, £ < .001 for test-item-response latency; 
and £(1, 123) = 39.2, £ < ,001 for total latency) with the rule groups taking 
considerably less time to study the displays and respond to the criterion 
Her*. The objective effect was significant, £(1,126) ■ 12. 8, 

p *• .001, only or. test-item-response latency with the objective groups 
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requiring less time to respond to the test items than non-objective 
groups. There also was a significant interaction, F( 1,126) '=4. 2, 

£ < .05, with test-item-response latency as criterion, This interaction 
indicates that the objectives had a greater effect in reducing response 
latency when added to a task which had no other focusing or organising 
stimuli than they did when adued to a task which had other effective 
orienting stimuli such as rules. In other words, the difference in 
response latency between the example only and objective groups was greater 
than the corresponding difference between the rule and objective-rule 
groups. 



Insert Table 2 about here 



Since the experimental procedure required all Ss to perform at 
a minimum criterion 1 e vel on each rule before proceeding to the next 
rule, no group mean differences were expected on the posttest. The con- 
firmation of this expectation made it possible to attribute any group dif- 
ferences on retention or transfer to the differential treatments rather 
than to differential posttest performance. Even though the rule groups 
received significantly fewer examples and took significantly less time to 
learn the task, their performance on the transfer test was significantly 
higher than that of the no-rule groups (F(l,126) = 7.8, £ < .01). The 
objective effect did not reach significance at an acceptable level, but 
it did approach significance, F(l,128) * 3.1, £ < .10, with the objective 
groups obtaining higher mean transfer scores than the no-objective groups. 
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However, there were no significant' group mean differences cn the retention 
test. The post, retention, and transfer test means and standard deviations 
may be found in Table 3. 



Insert Table 3 about here 



The battery of cognitive ability tests was factor analyzed, but 
consisttnt with previous findings (Bunderson, Olivier, & Merrill, 1971) 
it was not possible to separate the factors of Induction and general 
reasoning. Therefore, a two-factor varimax solution which yielded the 
f'Ctors of reasoning and associative memory is presented in Table 4. The 
reasoning factor Is marked by the two induction and the two general reason 
ing tests. 



Insert Table 4 about here 



Regression analyses of the individual ability test scores, factor 
scores, and the criterion measures were conducted. significant ability 
by treatment interaction (F(3»122) = 3.16, £ < -05) was obtained using 
test- item-response latency as the criterion measure and reasoning factor 
scores as the covariable. The plot of the regression lines (Figure 4) 
shows that test-ltem-response latency has a high negative relationship to 
reasoning, as defined by the reasoning factor scores, for Ss In the example 
only group. However, further analysis shows that the corresponding relation- 
ship between reasoning factor scores and test- item-response latency is 
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significantly reduced (F{1,124) = 9.28, £ < ,01) for Ss In the other three 
treatments. Similar ability by treatment interactions were obtained using 
individual reasoning test scores as covariables with test-item-response 
and total latency as criterion. 



Ir.sc't Figure 4 about here 



discussion 

The design of the present study was such that all Ss were 
required to reach a minimum criterion performance at each level of 
the task before they were allowed to go on to the next level. This 
procedure was used to assure that all treatment groups would perform 
at the same level on the posttest. Unless all groups learned the 
original task equally well, differential performance on retention or 
transfer measures could not be Interpreted in terms of the organization 
nor structure provided by Instructional treatment. The results con- 
firmed the expectation of non-significant group differences on post- 
test performance. 

Since there was a negligible decrement in performance between 
the posttust and retention tests for all treatment groups, the retention 
Interval of two weeks may have been too short for the treatments to have 
had an effect on retention. However, contrary to the learning by dis- 
covery hypothesis, the presentation of rules facilitated performance on 
the transfer task. Even though the rule groups received significantly 
fewer examples and took significantly less time to loam the task, their 
performance on the transfer test was significantly higher than that of 
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the no-rule groups. It seems that precisely stated rules have a greater 
effect on transfer retrieval than objectives. The weak objective effect 
may have been due to the fact that the objectives only specified that 
transfer retrieval would be required to solve new problems using previ- 
ously demonstrated relationships. 

An examination of the group frequency distributions with number 
of examples as criterion shows that the presentation of rules enabled 
most Ss to learn the science in a minimum number (10) of trials and 
therefore with nearly zero errors. Objectives had a similar but less 
pronounced effect. Since the rule treatments brought such a high per- 
centage of Ss to perfect performance in terms of the number of examples 
required, the full impact of these treatments, using number of examples 
as criterion, was Indeterminate. However, the within group variance 
was not similarly restricted in the latency criterion measures. 

The hypothesis that the presentation of rules would reduce the 
amount of time required to learn the task was supported by significant 
rule effects on all three latency measures. The presentation of objec- 
tives did not have the hypothesized effect of reducing the total time 
required to’ complete the task. This result would seem to contradict the 
argument that objectives have a focusing effect if it were not for the 
reduction In the number of examples required by the objective treatments. 
A comparison of the component latency measures, display and test-ltem- 
rcsponse latency, revealed that otjectlves either Increased or had no 
effect on display latency but significantly reduced test-item-response 
latency. Apparently, the presentation of objectives affected the effic- 
iency and effectiveness of the S' s Information processing and thereby 
facilitated his performance on the criterion test Items. 
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The presentation of objectives and/or rules did significantly 
reduce the relationship between reasoning factor scores and test-iiem- 
response latency. iVhy the treatments interacted with reasoning abilities 
using test-item-rosponse latency and total latency as criteria and did not 
interact significantly with display lately and number of examples as 
criteria Is not clear. Apparently, reasoning abilities are more crucial 
during those stages of the task where Ss respond to the criterion test 
1 terns . 

The hypothesis that objective effects would be greater between 
the example only and objective groups than between the rule and rule- 
objective groups was only supported by the significant interaction found 
with test-itom-response latency as criterion. However, an examination 
of the means for the other criteria shows that the corresponding differ- 
ences between the means are consistent with the hypothesis. Thus, it 
is impossible to make broad or general statements about the effect of 
objectives on the learning process without taking into account the other 
stimulus properties of the task. 

On the basis of the result of this study, it was concluded that 
objectives have orienting and organizing effects which dispose students 
to attend to and organize relevant information and thus facilitate 
performance on criterion- test items constructed in accordance with the 
objectives. However, these effects are not as pronounced when the learn- 
ing task contains other orienting stimuli such as rules. 
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TABLE 1 



Group Meins and Standard Deviations of the Number 
of Exariples Required to Learn the Task 
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OBJECTIVES 


NO 


YES 
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SD 
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SD 


No 


15.0 


3.6 


11. P 


2.0 


YES 


13.3 
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3.4 


10.6 
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TABLE 2 



Group Mpans and Standard Deviations for Display 
Latency, Test-Item-Response Latency, 
and Total Latency In Seconds 



Group 






Latency 




*“T. 


Display 


Test-Item-Response 


Total 


Means 


SO 


Means 


SD 


Means 


SO 


Example-Only 


821.2 


379.8 


923.3 


430.7 


1772.8 


771.7 


Objective-Example 


865.8 


377.5 


649. 3 


253.9 


1513.5 


569.5 


Rule-Example 


543.9 


208.6 


493.7 


211.7 


1037.6 


399.1 

> l 


Objective-Rule-Example 


634.3 


218.2 


419.8 


128.2 


1053.5 


321.2 
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TABLE 3 



Group Means and Standard Deviations for Posttest, 
Retention Test, and Transfer Test Scores 



.... == — = 1 

! 

i Group 

i 

} 


Posttest 


1 Retention Test 


Transfer Test 


Means 


! so 


Means 


SD 


Means 


SD 


i 

Example Only 


45.5 


! 

4.9 


44.2 


7.2 


11.0 


2.8 


Objective-Example 

i 


44.3 


11.7 


43.3 


13.9 


13.2 


4.4 


j Rule-Example 


45.1 


12.9 


43.6 


14.2 


14.1 


5.9 


i 

' Objective-Rule-Example 

i 


47.8 


12.2 


46.2 

1 


12.2 


14.7 


5.0 
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TABLE 4 



Varimax Rotation 



Factor Matr1x ? ' 



f 

I 

| TESTS 


FACTOR LOADINGS 


i 

i 

J . • . 


1 

REASONING 

FACTOR 


i 

'ASSOCIATIVE MEMORY 

FACTOR | 


1 

I Memory of Number 
| Se^es 


1877 


8336 


Firsthand Last Names 
Test 


0078 


8465 


61 -Column Number 
Series 


6001 


08p2 


Letter Sets 


7p06 


1964 


! Tote Mobile 


7458 


1607 


i Ship Destination 

1 

i j 


8191 


-1103 



a Deciiftal points are omitted. 







OBJECTIVE 



Given the values of F.F., ACS and the previous distance, predict 
the value of the next distance. 



RULE 

The screase in distance between each tine is equal to the value 
of F.F. x ACS. 







EXAMPLE 








F.F. = 2 
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TEST ITEM 
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F.F. = 3 












System Time 
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BLIP Time 


Satellite Distance 




ACS 


0 






45 




5 


1 
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What is the value of the distance at tine 1?. 



Figure 1. --Sample Xenograde Materials 
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ONLY 


EXAMPLE 


NO 


"X" 


"R" 




(n « 32) 


(n = 32) 




OBJECTIVE 


OBJECTIVE 




EXAMPLE 


RULE EXAMPLE 


YES 


"0" 


"RO" 




(n * 33) 


(n - 33) 



Figure 2 . —2 x 2 factorial design used In this 
study 





ocsuf'ocoocsj^; 
S Jh r-i -h csj co co 



otvj'tvocoocsi^; 
■J — I .H ^ H c J CO CO 



O rvi H- VO 00 O CM 
s ^ 75 ^ cvj CJ csj 



OOJ^^WOCvJ^ 

HHHHHMNCVI 



NUMBER OF EXAMPLES 

FlQure 3 . --Frequency Distribution by Treatment Group of the 
Nurrfre' of Examples Received 



i O 



ERLC 



o 



< 



CO 

Ui Q 
CO ^ 

z o 
<=> o 

*■ UJ 
^ CO 
LlI 



a: 



i 




UJ 






I 

CO 

UJ 

f- 




REASONING FACTOR SCORES 



Figure 4. --Interaction of Reasoning Factor Scores and 
Treatments with Test- Item- Response Latency 
as Criterion 




